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Claims 31 and 50 have been eaacclcd. Thus, Clidms 22-30 and 32-49 arc active in the 
present application. 

The present invention relates to a method for allocating bits to encode each frame of an 
image sequence, where each firame has a plurality of objects. The invention further relates to an 
jqjparatus for encoding each Irame of such an image sequence, as well as a computer-readable 
medium having stored thereon a plurality of instructions which, when executed by a processor, 
perform the steps of the method* The method (as set forth in amended Claim 22 above) 
generally comprises; 

(a) determining a target frame bit mte, Tihtmc for the frame in accordance with 
a quanUxer scale for each object in the frame; 

(b) allocating die target frame bit rate among the plurality of objects in 
accordance with the formula: 

Vi=K|XTfi«mc 

where V| is a target object bit rate for each object, and Ki is proportional to an average pixel 
value for the object; and 

(c) recursively adjusting the target frame bit rate for each frame in the 

sequence. 

In further embodiments, the present invention relates to a computer-readable medium 
(containing instructions to perform the present method; sec amended Claim 32 above), and an 
apparatus For encoding each frame of an image sequence. The apparatus (as set forth in amended 
Claim 29 above) generally comprises: 

(a) a motion compensator for generating a predicted image of a cuaent frame; 

(b) a transfomi module for applying a transformation to a difference signal 
between the current frame and the predicted image, where xht transformation produces a 
plurality of coeflScicnts; 
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(c) a quantizer For gmmtizins the plurality of coefficients with at least one 
quantizer scale; and 

(d> a controller for selectively adjusting the at least one quantizer scale for a 
current frame in response to a target object bit rate for each of the plurality of objects, and for 
determining the target object bit rate from a target frame bit rate in accordance with the formula: 

Vi = KixT(hiw 

where V\ is a target object bit rate for each olgect, and Ki is proportional to an average pixel 
value for the object. 

The primary reference cited against the claims (Eleftheriadis ct aU U.S. Pat No. 
6,055;J30 [hereinafler "Elcfthcriadis'T) does not disclose allocating a target frame bit rate among 
the objects in a frame according to an average pixel value for the object nor does Eleflhcriadis ct 
al. appear to disclose the present recursive adjustment step (sec amended Claim 22), While 
Eleftheriadis menUons the quantization of pixels and frames that comprise a plurality of objects, 
one bcnefil of the present claimed method is that the target bit rates can be prioritized based on 
the relative need of the objects for the available bits (as reflected by the average pixel value) in a 
given application, mther than on the si» of the objects. Furthermore, Eleftheriadis docs not 
disclose a controller for determining the target object bit rates from a target frame bit rate in 
accordance with an average pixel value for the objects (sec Claim 29). Consequently, the present 
claims are patentable over the cited references. 

Thus, an advantage of the presently claimed invention is that an object having a smaller 
number of pixels, but needing more bits (e^g., in terms of encoding syntax information, motion 
information and/or shape information; see, e.g,, page 14, lines 2-7 of the present specification), 
can have a greater proportion of the available bandwidth, or target frame bit rate, than a larger 
objea that does not need as many bits. In contrast, the approach of Eleftheriadis appears to 
assign a certain proportion of the available frame bandwidth bused solely on the size of the 
object, without reference to die relative need for encoding bits by the various objects in the 
frame. The secondary reference, Klem Gunncwiek, fails to cure this deficiency* 
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ClmTTi.'Reiections under the JudJciallv Created Doctrine of Double Patenling 

Applicants pro\dsionally agree to file a terminal disclaimer to overcome the non-statutory 
double patenting rejection of claims 22-24, 27-34 and 37-38- In particular* Applicants will file 
the terminal disclaimer if and when all of the other claim rejections have been resolved, 

T1ie_Reiecrion_ofCLMms 22-30 and 32>^^^^ U.S>C S 1_03fal 

The rejection of claims 22-30 and 32-50 under 35 U.SX* § 103(a) as being unpatenlable 
over Elcfthenadis (U.S. Pat No. 6,055,330) in view of Klein Gunnewick (O.S, PaL No. 
5,606,371) i& respectfully traversed, 

Elcfthcriadis discloses a method and apparatus For performing digital image and video 
segmentation and compression using 3-D depth information (Title), In contrast to the present 
claims 22 and 32» which recite allocating the target object bit ratc($) in accordance with the 
target frame rate and an average pixel value for the object, Elefthcriadis appears to determine a 
target object bit rate based on a quantizer (the value of which appears to be related to the distance 
of the object from the camcm; see, e.g., coL 11, II. 1-15 and 41-44) and the proportion of pixels 
in the object (sec, e.g., col 11,1 65-coL 12, 1 10); Thus, Elcfthcriadis is deficient with respect 
to the present claims. 

For example, Elcfthenadis teaches that the frame bit rate is aivcn (e.g., determined a 
priori, and apparently dependent on the bandwidth of the channel which is accepting data from 
the buffer; sec p. 9 of the Amendment fUcd December 15, 2005). Thus, Elcfthenadis appears to 
be silent with regard to rcciffsively adjusting a target frame rate, as recited in claims 22 and 32. 
Furthermore, the rate control performed by placing a buffer 320 at the otrtput 310 of the variable 
bit rate (VBR) encoder 200 and having a rate controller 340 takes into account the occupancy of 
the buffer and other parameters that are possibly signal dependent in order to decide the 
quantizer step size in quantizer 251, so that the bufler docs not overflow or underflow (col 8. IL 
17-27, and Fig. 2-3). This technique as taught by Elcfthcriadis only describes a feedback 
mechanism where the mte controller processes the output parameters of the buffar to adjust the 
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encoding rate (Fig 3). It cannot be reasonably interpreted os recursively adjusting the target 
fiame bit rate for each fhune in an image sequence, a5 recited in the present claims 22 and 32. 
Therefore, fileftheriadis is deficient with respect to the recitation of "recursively adjusting the 
target frame bit rate for each frame in the sequence" in the present claims 22 and 32. 

Furthermore, Elcftheriadis fiiils to disclose allocating a target frame bit rate among a 
plurality of objects, in accordance wi tb the formula Vj = Ki x Tfmmc where V| is a target object bit 
rale for eacih object, and K| is proportional to an average pixel value for the object 

Eleftheriadis discusses two coding techniques for controlling bit rales, variable bit rate 
CVBR) coding and constant bit rate (CBR) coding (see coL 8, U. 8-19 and col 11, U. 39-64). 
HleRheriadis discloses a constant bit rate encoder (FIG. 10), in which an object map generated by 
object segmentation circuit 500 is received by a macroblock labeling circuit 11 00 (sec coL 10, 1. 
65-col 11, L 1), Since the encoder splits each frame of video information received from the 
camera into macroblocks and quantises OCT coefficients on a macroblock basis, Elcftheriadis 
leaches that it is desirable to assign each macroblock of video data to a specific object, or in the 
cose oF a simple segmentation technique described therein, to a region which contains one or 
more objects at the same depth from the camera (coL 11, II. 1-8), Once the macroblock 
including pixels from an object or region has been assigned, it vwll be assigned to one object or 
region by macroblock labeling circuit 1100, a rate controller 1040 can select aa appropriate 
quantizer step size for the entire current macroblock (coL 1 1, 11. 12-1 5). 

For CBR coding, the rate controller 1040 must addkionally regulate quantizer selection 
so that the output buffer 1020 neither overflows nor underflows. Since tlie total number of bits 
per second which may be output is now Jbced, object sizes become important (coL 1 1, U- 53-57; 
emphasis added). In accordance with a known technique for performing arca-sclcctivc rate 
control when the object locations are known, each object is associated with a particular target 
average bit rate Rj, except for the background (object n)* Thus, in CBR coding, Elcftheriadis 
appears to dctcnnine a target object bit rate based on a quantizer value, rather than an allocation 
in accordance -with the target frame rate, as recited in the present claims 22 and 32. 
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In order to maintain the givca total average rate R necessary lo prevent buffer overflow, 
the background rale is determined according to EQ, (4): 



where at is the proportion (from OM to LO) of the pixels in the frame that belong to object i (eoL 
1 M 67-col 12, 1. ID; emphasis added)* Thus, Elcflhcriadis determines a target object bit rate 
based on tfte proportion of pixels in the object^ rather than an average pixel value for the object 
Thus, Eleflhcriadis is deficient with respect to the present cldms. 

Eleftheriadis explicitly teaches that it is possible that Rn (the baekground bit rale) is 
negative (col, 12, I 16). To one of ordinary skill in the art, this possibility of a negative 
background bit rate demonstrates that target object bit rates are not allocated in accordance with 
a target fnune rate. Rather, tlicy must be determined by some other technique (such as in 
accordance with a quantizer valiie, as explained above, which in turn appears to be based on the 
occupancy Bmax of a buffer [coL 3, II. 22-26], the output rate of which is constant and dependant 
on the bandwidth of the channel which is accepting data fix»m the bufTer; see col, 3, U. 17-22). 
Elellheriadis further teaches that the possibility of a negative background bit rate may simply 
have the effect of assigning as coarse quantization as possible to the background, and may result 
in less avemgc bits per second per object than the target bit rates R| indicate (col, 12, U 16-19), 
further confirming that target object bit rates therein arc not allocated in accordance with a target 
frame rate. 

Thus, there appears to be no reasonable basis in Blcftheriadis for an assertion that EQ. (4) 
is used to determine the target frame rate; to the extent R may be related to a target frame rate, 
Eleflheriadis teaches that it is given (as discussed in tiic preceding paragmph, dependent on the 
bandwidth of the channel which is accepting data from the buffer). Consequently, in the relevant 
discussion of CBR coding, Eleflheriadis fails to disclose step of allocating the target fiwnc bit 
rate in accordance with a target object bit rate as presently claimed. 
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AIso» as discuss^ above, since ElefthcriBdis teaches that the irame bit rate is related to 
the occupancy of a buffer ha^dng a constant output rale that is, in turn, dependent on the 
bandwidth of the channel which is accepting data Srom the buTTer, ElcfUicriadis cannot disclose 
or suggest to one of ordinary skill in the art that the frame bit rate can be (much less should be) 
adjusted. Thus, Elcftheriadis E^)pcars to be silent with regard to recursively adjusting a target 
fiame rate, as recited in claims 22 and 32* 

For VBR coding, Eleflheriadis teaches that macroblock labels can be directly used for 
rate control by associating particular quantizer step sizts with each object (coL 11, 11. 39-41). 
The encoder can also employ techniques to "smootli out" quantiser differences at object 
boundaries by gradually changing the quantization step while entering or exiting an object (coK 
11, 11, 47-50). A macroblock labeling circuit 1100 (sec FIG, 11) contains object identifications 
for each pLxcl in the macroblock (col 11, 11. 16-19), and quantizer selection is simply a lookup 
opemtion into a table which indexes the possible object identifications generated by macroblock 
labeling circuit 1100 (col 11, 11. 44-4-7). Also, Elcftheriadis teaches that rate control is also 
usable in a purely VBR encoder to provide higher quality for some image areas, and less for 
areas that have smaller significance (c.g., backgrotmd areas). As a result, the tcmi rate control is 
used by Elcftheriadis generally without discriminating whether or not a CBR or VBR encoder is 
used (col. 8, U. 40-47). Thus, the discussion of VBR coding by Elcfihcriadis fiiils to cure any 
deficiency of Elcftheriadis with regard to the allocating step in the present claims 22 and 32. 

C:onscquentiy, EldUieriadis fails to disclose the steps of (i) allocating the target frame bit 
rate in accordance with an average pbccl value for the object and (ii) recursively adjusting the 
target frame bit rate, as presentiy recited in claims 22 and 32. As such, Elcftheriadis docs not 
anticipate the present claims 22 and 32. Therefore, this ground of rejection should be withdrawn 
with regard to claims 22, 32, and clakns dependent therefmm. 

Furthermore, Elcftheriadis fails to disclose the controller of claim 29, which determines 
the target object bit rate &om a target frame bit mte in accordance with an average pixel value for 
each of the objects. As discussed above, Elcftheriadis determines a target objca bit mte based 
on the proportion of pixels in Ute object^ ratlier than an average pixel value for the object. In 
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addition, EleHheriadis discloses a rate controller 1040 that regulates quantiser selection so that 
the ouipul buCfcr 1020 neither overflows nor underflows (coL U, IL 53-57)- However, the 
output raie of the buffer is constant and dependant on the bandwidth of the channel which is 
accepting data fiijm the btrffer (see col. 3, lU 17-26)* Elcfthcriadis docs not appear to disclose 
any connection between the bandwidth of the channel v/bich is accepting data from the buGer 
and a target ftamc bit rate* As a result, Hleftlteriadis is deficient with regard to the present claim 
29. 

Klein Gunnewiek discloses a device for encoding a video signal comprising means for 
dividing each picture into a plurality of sub^pictures, an encoder comprising a picture 
transformer For transforming each sub**picture into coefficients, and a quantizer for quanti:dng 
the coefficients with an applied step size (coL 1, 11. 5-10). Klein Gunnewiek neither discloses 
nor suggests allocating a target ftame bit rate among the objcct(s) in a frame according to an 
avcmgc pixel value for the object, nor recursively adjusting the target fiamc bit rate for each 
frame in the sequence. The derivation of target frame rates from the equation of different 
targeted firames and pictures as taught by Klein Gunnewiek cannot be reasonably interpreted as 
allocating a target ftame bit rate among the objects in a ftame (or determining the target object 
bit mie from a target frame bit mte) in accordance with an average pixel value for the object. 
Thus, Klein Gunnewiek fails to cure the deficiencies of Eleflheriadis with respect to allocating 
the target frame bit rate among the objects in each firamc in accordance with the formula V| = K| 
X Tftnmcj where V| is the target object bit mte for each object, and Ki is proportional to hn average 
pixel value for the object, and recursively adjusting the target frame bit mte for each Irame in the 
sequence, as recited in claims 22 and 32* Similarly, Klein Gunnewiek fails to cure the 
deficiencies of Elefthcriadis with respect to or determining the target object bit mie for each of a 
plurality of objects in a frame from the target frame bit rate, as recited in the present claim 29. 
Consequently, no possible combination of Elefthcriadis and Klein Gunnewiek can suggest the 
present claims 22, 29 and 32. 

As a result, this ground of rejection is unsustainable, and should be withdrawn* 
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Conclasions 

In view of the above amendments and remarks, all bases for rejection arc overcome, and 
the appHcalnon is in cotjdition for allowance. Early notice to that cflFcct is earnestly requested^ 

If it is deemed helpful or beneficial to the efficient prosecution of the present appUcation, 
the Exominer is invited to contact Applicant's undersigned representative by telephone^ 



Respectfully submitted. 




Andrew D. Fortney, ?hX>. 
Reg.No* 34,600 



401 W. Fallbrook Avenue, Suite 204 
Fresno, Call Fomia 937X1 
(559)432-6847 

ADFijfs 
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